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Abstract:  ’In  this  paper  we  derive' ,  stochastic  differential  equations  for  recursive 
maximum-likelihood  estimates  for  the  Joint  filtering-parameter  estimation  problem. 
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1.  INTRODUCTION 

In  this  paper  we  would  like  to  consider  the  joint 
states  and  parameter  estimation  problem  for  the 
following  non-linear  stochastic  differential 
system: 

dx(t)  -  f(x(t),8)dt  ♦  g(x(t),0>dw(t).  0<tiT  (1.1) 

with  the  observation  system 

dy(t)  -  h(x(t),9)dt  ♦  dv(t) ,  0<t<T.  (1.2) 

In  the  above,  w(t)  and  v(t)  are  standard 
Independent  Brownian  motions,  f,g,h  are  at  least 
thrice  continuously  differentiable  with  bounded 
derivatives  with  respect  to  xtH  and  0«R  and 
g(x.0>  >  o>0,  Vx,  9«H. 

In  addition  we  assume 


f |h(x(t) ,0) 


|  dt  <  -, 


where  -  denotes  a  backway  stochastic  differential 
(and  backward  Ito  Integral  respectively). 


L(9,t)  -  E(A(0,t)  |x(t)-z),  (1.6) 

where  E  denotes  expectation  with  respect  to  the 
path  space  measure  of  x(‘). 

As  a  criterion,  we  choose  as  an  estimate 

2(t)  -  Arg  Max  L(z,0,t). 
z.0 

which  Is  a  maximum  likelihood  criterion. 

2.  STOCHASTIC  HAMILTON-JACOBI  BELLMAN 
EQUATION  FOR  L(z,9,t) 

Using  the  work  of  Fleming-Mltter  (11  and  the  theory 
of  backway  stochastic  differential  equations  [cf. 
Kunlta,  loc.clt]  one  can  show  that 


and  the  Initial  state  satisfies 


Either  1)  x(0)  -  *0*R 


11)  x(0>  »  Xq.  a  random  variable  with 

density  pQ(x)  «  C2(R)R),  p0(x)>0. 


s(z,e,t>  -  -In  L(z,0.t)  (2.1) 

satisfies  the  stochastlo  Bellman  Hamllton-Jacobl 
equation: 


dstx.e.t)  -  o(x ,0) (S  -S  )dt  +  o(x ,0)S  dt  (2.2) 

XX  X  X 


Let  »3  ,(x)  denote  the  solution  of  the  stochastic 
differential  equation  (1.1)  smarting  at  x3*x.  Then 
from  a  result  of  Kunita  (2],  we  know  that  p3  t  is  a 
C^-dlffeomorphism.  and  the  Inverse  map' " 
satisfies  a  backward  stochastic  differential 
equation. 


♦  b(x,0>  dt  -  h(x,9).dy(t) 


c(x,9)  -  y  g(x,0)2 


r  1  i  2 

).t)  -  exp( j  h(x (s ) ,9)dy(s)  -  —  b  (x(s),9)ds) 

*  n  * 
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(x(t)),0)d7(s) 


-if  h(p'1,(x(t),0))2dti. 
2  J s.t 
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o(x.ft)  -la  -  2o(x,@)S  -  f(x.0) 

X  X 


S  -  -In  p  (x.t) 


where  under  our  assumptions  p^fx.t),  the  density 
corresponding  to  the  x(’)  process  exists  and  is 
positive  for  all  x.t. 

Ve  now  define  a  recursive  maximum  likelihood 
estimate.  By  applying  the  Generalized  Ito 
Differential  Rule  [cf.  Kunita,  loc.clt],  we  (jet 
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atVS  ♦  V2Sd«(t)  +  i.  73Sd<{,{>t-V(Vh)d<y,5>t  -  0 

(2.3) 


"U  ’  ,<l’  •  «<.. 


which  is  obtained  from  the  stationarlty  condition 


VS  -  0. 


In  {2.3)  all  partial  derivatives  are  computed  along 
(£. 9)  which  is  obtained  from  the  stationarlty 
condition  (2.4). 


Assuming  V^S  is  Invertible,  we  obtain  a  maximum 
likelihood  trajectory  for  {(t)  from  (2.2),  (2.3) 
and  (2.4)  and  using  3tVS  -  VdS. 


A  rigorous  derivation  of  these  results  will  be 
presented  elsewhere. 
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